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ABSTRACT: 

Suppose  that  A  is  a  positive  recurrent  Harris  chain  with  invariant  measure  7r.  We 
develop  a  Lyapunov  function  criterion  that  permits  one  to  bound  the  solution  g  to  Poisson’s 
equation  for  X.  This  bound  is  then  applied  to  obtain  sufficient  conditions  that  guarantee 
that  the  solution  be  an  element  of  Lp( x).  When  p  =  2,  the  square  integrability  of  g  implies 
the  validity  of  a  functional  central  limit  theorem  for  the  Markov  chain.  We  illustrate  the 
technique  with  applications  to  the  waiting  time  sequence  of  the  single-server  queue  and 
autoregressive  sequences. 
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1.  INTRODUCTION 


Let  X  =  ( Xn  :  n  >  0)  be  a  (temporally  homogeneous)  Markov  chain  living  on  a  mea¬ 
surable  space  ( S,S ).  Given  a  real- valued  ^-measurable  function  /,  Poisson’s  equation 
involves  solving 

(1.1)  g  =  Pg  +  f 

for  the  unknown  function  g,  where  P  is  the  transition  kernel  of  X.  The  solution  g  to 
Poisson’s  equation  is  fundamental  to  the  analysis  of  the  additive  function 

n— 1 

«.-£/(**)• 

k= 0 

Set  So  =  0.  The  principal  observation  that  underlies  the  analysis  of  (S„  :  n  >  0)  is  that  the 
behavior  of  such  an  additive  functional  is  closely  related  to  that  of  a  certain  martingale. 
Specifically,  let 

(1.2)  M„  =  g(Xn)  +  Sn 

for  n  >  0.  Set  Tn  =  cr(Xo, . . .  ,Xn).  Proceeding  formally,  we  note  that  since  g  solves  (1.1), 

Ez  [Mn+1\rn]  =  (Pg)(Xn)  +  Sn+i 

=  g(Xn)  +  Sn  =  Mn  Px  a.s. 

Hence,  under  suitable  integrability  conditions  on  /  and  g ,  it  follows  that  M  =  (M„  :  n  >  0) 
is  a  Px -martingale  with  respect  to  the  filtration  (Pn  :  n  >  0).  In  fact,  the  martingale  M 
is  just  the  discrete-time  analog  of  the  well-known  continuous-time  martingale  M(t)  = 
g(X(t))  -f  Jq  f(X(s))  ds,  where  /  =  —  Ag  and  A  is  the  (infinitesimal)  generator  of  the 
Markov  process  X. 

Returning  to  (1.2),  it  is  evident  that  the  asymptotic  behavior  of  (5„  :  n  >  0)  will 
typically  mimic  that  of  the  martingale  M.  In  particular,  laws  of  large  numbers,  central 
limit  theorems,  and  laws  of  the  iterated  logarithm  can  often  be  derived  for  (S’n  :  n  >  0)  by 
applying  appropriate  martingale  theorems.  For  example,  MAIGRET  (1978)  and  KURTZ 
(1981  use  this  approach  to  obtain  functioned  central  limit  theorems  (FCLT’s)  for  recurrent 
discrete-  time  Markov  chains,  whereas  BH ATTACH ARAYA  (1982)  uses  similar  techniques 
to  derive  FCLT’s  and  laws  of  the  iterated  logarithm  (LIL)  for  recurrent  continuous-time 
Markov  processes.  However,  in  order  to  successfully  apply  this  technique  to  a  given  chain, 
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one  must  basically  show  that  the  martingale  difference  sequence  Dn  =  g(Xn)  —  (Pg)(Xn-i ) 
is  appropriately  square  integrable. 

In  this  paper,  we  develop,  for  positive  recurrent  Harris  chains,  a  Lyapunov  function 
criterion  that  permits  one  to  verify  that  the  solution  geL2(n),  where  i r  is  the  (unique) 
invariant  measure  of  X.  This  guarantees  that  the  martingale  differences  are  well-behaved, 
so  that  the  above  mentioned  FCLT’s  apply.  Thus,  the  main  goal  of  the  paper  is  to  derive 
an  easily  applied  Lyapunov  function  technique  that  permits  one  to  verify  the  hypotheses 
necessary  in  order  to  assert  that  (5„  :  n  >  0)  satisfies  a  FCLT. 
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2.  THE  MAIN  RESULT 

Throughout  the  remainder  of  this  paper,  we  adopt  the  notation  and  terminology  of 
NUMMELIN  (1984)  and  REVUZ  (1984).  The  function  h  that  appears  in  the  following 
proposition  is  called  a  (stochastic)  Lyapunov  function. 

PROPOSITION  1.  Let  K  be  a  non-negative  a-finite  kernel  on  (S,  S).  Suppose  that 
there  exists  e  >  0  and  a  finite- valued  non-negative  function  h  such  that 

(2.1)  (A'/i)(x)  <  h(x)  -  e\f(x)\ 

OO 

for  x  6  S.  Then,  the  equation  g  =  Kg  +  /  has  a  solution  g*  =  Knf  that  satisfies 
|<7*(x)|  <  h(x)/e  for  x  G  S. 

Proof.  Since  e|/(x)|  -f  ( Kh)(x )  <  h(x),  it  follows  that 

(2.2)  eKn\f\  +  Kn+1h  <  Knh. 

Since  K°h  =  h  is  finite- valued,  induction  shows  that  Knh  is  finite- valued  for  all  n  >  0. 
Hence,  we  may  re-write  (2.2)  as 

(2.3)  eKn\f\  <  Knh  -  Kn+1h. 

m 

Summing  both  sides  of  (2.3)  over  n,  we  find  that  e  ^  Kn\f\  <  h  —  Km+1h.  Since  h  >  0, 

n=0 

it  is  evident  that  c^^_0/vn|/|  <  h,  from  which  it  follows  that  g*  =  ^  Knf  converges, 

n—0 

satisfies  g *  <  h/e,  and  is  a  solution  of  g  =  Kg  +  /. 

We  note  that  Proposition  1  does  not  typically  apply  to  recurrent  Markov  chains.  In 
particular,  suppose  that  there  exists  a  positive  invariant  measure  n  such  that  irh  <  oo. 
By  applying  7r  to  both  sides  of  (2.1),  we  find  that  (2.1)  can  only  be  satisfied  globally  if  / 
vanishes  ir  a.e. 

However,  (2.1)  can  provide  useful  information  for  substochastic  and  transient  kernels. 

EXAMPLE  1.  Suppose  that  X„  =  Xq  +  ei  +  . . .  +  e„,  where  the  c,’s  are  i.i.d.  real- valued 
r.v.’s  with  £exp(— Ae,)  <  1  for  some  A  >  0.  Suppose  f(x )  =  0(exp(— Ax))  as  x  — ►  oo. 
Then,  if  h(x)  =  exp(— Ax),  we  find  that 

(Ph)(x)  =  e~XzEe~Xtt 

<  e'Al  -  e|/(*)|  =  h(x)  -  e|/(x)|, 
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provided  that  e  =  (1  —  Eexp(—\e\))((3  +  l)-1,  where  (3  =  sup{exp(Ax)|/(x)|  :  x  €  R}. 
Hence,  for  /  satisfying  the  above  growth  condition,  Proposition  1  applies. 

We  henceforth  assume  that  P  is  the  transition  kernel  of  a  Harris  recurrent  Markov 
chain  with  non- trivial  invariant  measure  7r.  Then,  there  exists  an  integer  n  >  1,  a  non¬ 
negative  5-measurable  function  s,  and  a  probability  measure  v  such  that 

(2.4)  Pm>s®v 

with  tvs  >  0  (see  Section  2.3  of  NUMMELIN  (1984)). 

Suppose,  for  the  moment,  that  m  =  1  in  the  minorization  condition  (2.4) 

and  put 

OO 

n=0 

According  to  Theorem  3.1  ii)  of  NUMMELIN  (1985),  it  follows  that  if 

(<?.,„  |/|)(x)  <  oo 

for  all  x  £  S  and  uGa>vf  =  0,  then  /*  =  Ga<l/f  is  a  solution  of  Poisson’s  equation 

g(x)  =  ( Pg)(x )  +  f(x) 

for  all  x  6  S.  We  note  that  the  condition  vGa<vf  =  0  is  equivalent  to  requiring  that  it/  =  0 
(see  p.  73  of  NUMMELIN  (1984)). 

Our  goal  is  now  to  obtain  a  Lyapunov  bound  on  g.  Proposition  2  is  an  immediate 
consequence  of  Proposition  1. 

PROPOSITION  2.  Suppose  that  there  exists  e  >  0  and  a  finite-valued  non-negative 
function  h  such  that 

(2.5)  ((P  -  s  <g>  v)h)(x)  <  h(x)  -  e|/(x)| 

for  x  6  5.  If  7 r/  =  0,  then  g*  =  GSi„f  satisfies  g  =  Pg  +  f  and  the  bound  |<7*(x)|  <  h(x)/e. 

Before  proceeding,  we  note  that  the  solution  g*  is  often  unique,  in  a  certain  sense. 

PROPOSITION  3.  Suppose  that  g*eLl(iv)  is  a  solution  of  g  =  Pg  +  f  ■  Then,  if  g*(.Ll(tv) 
is  another  solution,  there  exists  a  constant  c  such  that  gm  —  g*  +  ctv  a.e. 
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PROOF.  Note  that  h  =  Ph ,  where  h  =  g*  —  gm  eLl(n).  Then,  it  follows  that  h  =  Ph  = 
P2h  =  ...  =  Pnh  so  h(x )  =  n-1  (P*/i)(x).  But  n-1  ^2(Pk h)(x)  — *  nil  as  n  — ►  oo  for 

fc=i  *=i 

7 r  a.e.  x  (Proposition  3.5  and  Theorem  7  of  NUMMELIN  (1978)).  Hence,  h(x)  =  ith  7r  a.e. 
To  prove  that  the  solution  g*  =  G3<vf  is  an  element  of  Lp(n),  we  can  use  the  following 
result;  the  proof  is  an  immediate  consequence  of  Theorem  1  of  TWEEDIE  (1983). 

PROPOSITION  4.  Let  X  be  a  positive  recurrent  Harris  chain  and  let  g*  =  GStVf.  Sup¬ 
pose  that  there  exists  /i  >  0  satisfying  (2.5),  and  a  non-negative  function  k,  rj  >  0,  and  a 
subset  B  €  S  such  that 

(Pk)(x)  <  k(x)  —  T]hp(x) 
for  x  G  Bc.  Then,  if  7r  is  normalized  to  be  a  probability, 

J  \h(x)\pir(dx)  <  \\IBh\\p  +  r?-1  ||JbP*||, 
where  ||r||  =  sup{|r(x)|  :  x  G  5). 

Unfortunately,  Proposition  2  is  difficult  to  apply  in  practice.  There  are  two  problem. 
Firstly,  the  function  /  that  is  of  interest  is  rarely  given  explicitly  as  a  centered  functional 
for  which  izf  =  0.  Also,  condition  (2.5)  can  be  difficult  to  verify  because  of  the  global 
character  of  the  inequality.  Theorem  1  remedies  these  problems. 

THEOREM  1.  Let  AT  be  a  Markov  chain  for  which  there  exists  a  set  A  G  <5  and  A  >  0 
such  that 

(2.6)  P(x,  •)  >  Ai/(-) 

for  all  x  G  A.  Suppose  that  there  exists  e,  rj  >  0  and  non-negative  finite-valued  5- 
measurable  functions  h  and  k  such  that 

(2.7)  (Pfc)(z)  <  M*)  -  ‘(I/Ml  + 1) 

(2.8)  (Pk)(x)  <  k(x)  —  r]h(x)p 
for  x  G  Ac  and  p  >  0.  In  addition,  assume  that 

IIWII,  l|4.Pft||,  ll-WII,  II/.PJ--II 

are  all  finite.  Then: 
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i)  X  is  a  positive  recurrent  Harris  chain; 

ii)  If  7r  is  the  (unique)  invariant  probability  measure  of  X ,  then  7r|/|  <  oo  and  Ga,„(|/|  + 
1)  <  oo; 

iii)  If  /  =  /  —  x/,  the  function  g *  =  G3>uf  satisfies  Poisson’s  equation  g*(x)  =  (Pg*)(x)  + 
f(x )  for  all  x  G  S: 

iv)  There  exist  constants  a  and  /3,  independent  of  x,  such  that  |<7*(z)|  <  ah(x)  +  /3  for 
all  x  E  S] 

v)  g*eLp(n). 

PROOF.  Let  K  be  a  non-negative  cr-finite  kernel.  For  A  €  S,  set 

OO 

I<A  =  Y.v~*riA 

n= 0 
oo 

Ha  =  'jT(IA.K)nIA* 

n=0 

oo 

C=E*“ 

n= 0 
oo 

F  =  '£(KAK)n[HA  +  Ka], 

n=0 

We  start  by  showing  that  G  =  F.  Note  that  G  =  I  +  R  +  Ia*KG,  where  R  =  IaKG. 
Iterating  this  equality  n  times,  we  find  that 

n 

G  =  ^(iA'KYil  +  R)  +  (IA'I<)n+1G. 

j=o 

Hence,  G  >  +  R).  Letting  n  — >  oo,  we  find  that 

j=o 

OO 

G>Y,(^K)n(I+lAKG) 

n=0 

oo 

=  Y,Va‘KT(Ia.  +  IA  +  IaKG) 

n= 0 

=  H A  +  I(a  +  KaKG. 

Iterating  this  last  inequality  n  times,  we  get 

n 

G  >  YJLKaK)>{Ha  +  JO)  +  (KAK)n+1G 

j= o 

n 

>Y,(KaK)’(Ha  +  Ka). 

j= 0 
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Letting  n  — »  oo,  we  obtain  the  inequality  G  >  F.  On  the  other  hand, 

F  =  Ha  +  Ka  +  KaICF 

OO 

=  £(/,,.  AT[/„.  +  u  +  UKF] 

n= 0 

oo 

=  1  +  IaKF  +  ^2(IAcK)n[IAc  +IA  +  IaKF } 

n=0 

=  1+  IaKF  +  IAcKF  =  I  +  KF. 

n 

By  iterating  the  equality  n  times,  we  conclude  that  F  =  7C7  +  Kn+1F.  Thus,  F  > 

i= o 

n  oo 

X)  TsT-7 .  By  letting  n  — »  oo,  we  conclude  that  F  >  proving  that  G  =  F. 

j=0  n=0 

We  now  let  JC  =  P  —  s  ®  ja  Note  that 

IAcPh  >  IAcPIAch  >  IAeK IAeh. 

Combining  this  inequality  with  (2.7),  we  conclude  that 

Kh  <h  —  ef, 

where  K  =  IAcK,  h  =  IAch,  and  /  =  IAc(\f  \  +  1).  Proposition  1  then  implies  that 

OO 

(2.9)  Y,  K’f  =  +  !)  <  V*  =  IA.h/e. 

n= 0 

For  a  non-negative  kernel  W,  let  ||TV||  =  sup{W(x,  5)  :  x  €  5}  <  oo.  Since  KA(\f\  +  1)  = 
KAIA(\f\  +  1),  it  is  evident  that  117^(1/1  +  1)||  <  \\PAIA(\f\  +  1)||  <  \\IAf\\  +  1.  We  now 
combine  this  bound  with  (2.9)  and  the  fact  that  GSil/  =  F  to  obtain 

OO 

G.A\n  + 1)  =  Y(k*k)'(.«a + K*w\ + 1) 

n= 0 
oo 

<  y,(KaK)'W‘ + ii  un  + 1) 

n=0 

oo 

=  h/t + Y(K*K'>’iK*Kh/e+ + ii 

n=0 

oo 

<  h/t+  YwAiKT^uKhwit+wuiw  + 1) 

n=0 
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But  \\KaK\\  <  || /vA||  || A' ||  <  ||P/i||(l  —  A)  =  (1  —  A).  This  provides  us  with  the  bound 


(2.10)  G,,Mf\  +  1)  <  h/Xe  +  A-,[||/j,PA||/€  +  ||iU/||  +  1). 

We  also  observe  that  condition  (2.7)  guarantees  that  J^eP/i  <  I^c h  —  cIa*!-  The  test 
function  criterion  developed  by  TWEEDIE  (1976),  in  conjunction  with  (2.6),  then  proves 
that  X  is  a  positive  recurrent  Harris  chain.  (See  ATHREYA  and  NEY  (1978)  for  a  dis¬ 
cussion  of  the  definition  of  a  Harris  chain  that  is  suitable  for  our  present  purposes.)  As  a 
consequence,  Theorem  1  of  TWEEDIE  (1943)  implies  that 

k/l<  IIWII  +  e-'II^PAII. 

Thus,  by  applying  (2.10),  we  get 

\G.J\  <  G.,„( |/|  +  Itt/I  •  1) 

<  G»,v\f\  +  \*f\Ga,v  •  1 

<  (1  +  \*f\)G.A\f\  + 1) 

<  ah  +  /? 

for  suitable  constants  a  and  proving  iv).  The  bound  on  the  Ap-norm  of  the  solution 
g*  =  Gs<vf  to  Poisson’s  equation  then  follows  immediately,  upon  application  of  Theorem 
1  of  TWEEDIE  (1983)  to  the  function  h. 

Although  Theorem  1  covers  a  great  many  applications,  there  are  certain  settings  in 
which  the  minorization  condition  (2.4)  does  not  hold  with  m  =  1.  The  remainder  of  this 
section  is  devoted  to  discussing  the  modifications  necessary  in  order  to  deal  with  m  >  1. 
Set 

oo  m— 1 

(2.11)  =  £[P" -a®*]"  Y.  P‘ ■ 

n=0  j= 0 

According  to  Theorem  3.5  to  NUMMELIN  (1985),  the  function  g*  =  GStTntUf  satisfies 
Poisson’s  equation  g(x)  =  ( Pg)(x )  +  f(x)  for  n  a.e.  x  whenever  irf  =  0.  (Actually, 
the  statement  of  the  result  is  that  g*  solves  Poisson’s  equation  on  a  closed  domain  of  5. 
However,  Proposition  2.5  of  NUMMELIN  (1984)  asserts  that  the  complement  of  any  closed 
domain  has  n -measure  zero.) 
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To  carry  out  the  program  followed  in  the  case  m  =  1  for  the  case  m  >  1  is  now 
straightforward.  We  need  to  bound  |Gm,s,i//|  by  a  Lyapunov  function  of  some  kind.  Note 
that 


=  J2  K"f’ 


where  K  =  Pm  —  and  f  =  ^  P-7/.  A  similar  analysis  to  that  used  to  derive  Theorem 

j=o 

1  then  yields  the  next  result. 

THEOREM  2.  Let  X  be  a  Markov  chain  for  which  there  exists  a  set  A  £  S  and  A  >  0 
such  that 


(2.12) 


for  all  x  €  A.  Suppose  that  there  exists  e,  tj  >  0  and  non-negative  finite-valued  <5- 
measurable  functions  h  and  k  such  that 

(Pmh)(x)  <  h(x)  -  '  ^(P‘|/|X*)  +  1  j 
(Pk){x)  <  k(x)  -  rjh(x)p 

forr  6  Ac  and  p  >  0.  In  addition,  assume  that  ||7yiPfc|/|||(0  <  k  <  m- 1),  \\IAPmh\\,  ||/a^||,  ||^-P^'|| 
are  all  finite.  Then: 

i)  AT  is  a  positive  recurrent  Harris  chain; 

ii)  If  7r  is  the  (unique)  invariant  probability  measure  of  X ,  then  7r|/|  <  oo  and  Gm,j,i/(|/|+ 

1)  <  oo  for  all  x  €  S] 

iii)  If  /  =  /  —  7 rf,  the  function  g*  =  Gm,s,vf  satisfies  Poisson’s  equation  g*(x)  = 

(P<7*)(x)  +  jf(x)  at  7 r  a.e.  x\ 

iv)  There  exists  constants  a,  /?,  independent  of  x,  such  that  |<7*(x)|  <  a/i(x)  +  (5  for  all 
x  €  5; 

v)  g *  G  Lp( 7r). 

We  note  that  there  always  exists  a  set  A  satisfying  (2.12)  if  X  is  a  Harris  chain.  Further¬ 
more,  in  many  applications  settings,  the  set  A  will  be  compact  and  /,  h ,  and  k  continuous. 

If  the  transition  function  P  is  Feller  (i.e,  Pr  is  bounded  and  continuous  whenever  r  is), 
then  P'/,  PJ/i,  and  Plk  will  usually  be  continuous  (this  is  automatic  if  the  functions  are 
bounded),  and  the  finiteness  of  ||7^P*/||,  ||7^PJ/i||,  and  ||7,iP*fc||  is  then  immediate. 


We  conclude  this  section  with  an  application  of  our  results  to  the  question  of  when  a 
FCLT  holds  for  an  additive  functional  of  a  Markov  chain  X . 

THEOREM  3.  Suppose  that  either  Theorem  1  or  Theorem  2  is  in  force  with  p  =  2.  Then, 
there  exist  constants  r  and  a  such  that  Zn  =s>  oB  PM-weakly  as  n  — ►  oo  in  D[0,  oo)  (for  p 
is  an  arbitrary  probability  measure  on  (5,5)),  where 

Furthermore,  the  constants  r  and  <t2  can  be  defined  as  r  =  ir/  and  o 2  =  7r(<7*)2  -7r( Pg *)2, 
when  g*  is  defined  as  in  Theorems  1  and  2. 

This  basically  follows  from  MAIGRET  (1978).  Our  theorem  actually  requires  a 
slightly  strengthened  version  of  her  result,  because  Theorem  3  asserts  that  the  weak  con¬ 
vergence  holds  for  any  initial  distribution  p.  To  obtain  our  result  from  MAIGRET  (1978), 

let  Antt{B)  =  {n-1/2  ^  /(AT*)  —  r-^j  £  B},  for  B  a  (measurable)  subset  of  D[0,  oo).  If 

A  is  an  aperiodic  Harris  chain,  then  pPe  converges  to  7r  in  total  variation  norm.  As  a 
consequence, 

sup  | P^A^B))  -  Pr(An<t(B))\  -►  0 

H>1 

B 

a si—*  oo.  Since  MAIGRET  (1978)  does  establish  weak  convergence  under  Pn,  it  is  evident 
that  P,(Ani/(-))  P{aBe-}  as  n  — ►  oo.  Noting  that 

n~I/2  (E /(**)-*•) =>0 

P^-weakly  in  D[ 0,  oo),  we  may  therefore  conclude  that  Zn  =>  cB  P^-weakly.  Thus,  Theo¬ 
rem  3  holds  under  any  initial  distribution  p.  (A  slight  variation  in  this  argument  handles 
the  case  when  X  is  periodic.) 
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3.  EXAMPLES 


In  this  section,  we  illustrate  our  Lyapunov  function  techniques  with  a  couple  of  ex¬ 
amples. 

EXAMPLE  2.  Let  Xn+i  =  [AT„  +  r;n+1]+,  where  (r/n  :  n  >  1)  is  i.i.d.  For  simplicity  of 
exposition,  we  require  that  ryn  have  a  distribution  that  satisfies  P{rjn  <  x}  >  0  for  all  x. 
The  chain  X  =  ( Xn  :  n  >  0)  can  be  viewed  as  the  waiting-time  sequence  of  a  single-server 
queuing  system  (see  ASMUSSEN  (1987)).  It  is  well  known  that  if  E\rh\  <  oo,  then  it  is 
necessary  that  Eg i  <  0  in  order  that  X  be  a  positive  recurrent  Harris  chain.  Furthermore, 
it  is  easy  to  see  that  condition  (2.6)  holds  for  any  compact  set  A  C  [0,oo)  (we  can  then 
take  v  to  be  a  point  mass  at  zero). 

Suppose  that  f(x)  =  x.  Then,  if  Erji  <  0  and  E\t]i\5  <  oo,  we  can  choose  h(x)  =  x2 
and  k(x)  =  x5.  Note  that 

(Ph)(x)  =  h(x)  +  2  f(x)Ern  +  0(1) 

( Pk)(x )  =  k(x)  +  5h(x)2Erji  +  0(x3) 

as  x  — ►  oo.  By  choosing  e,  rj,  and  K  appropriately,  it  is  evident  that  (2.7)  and  (2.8) 
can  be  made  to  hold  for  x  >  K.  By  choosing  A  =  [0,/v],  we  find  that  Theorems  1  and 
3  then  apply.  Hence,  Sn  =  X\  +  . . .  +  Xn  satisfies  a  FCLT  if  Erj1  <  0,  ^|t?i|5  <  oo, 
and  P{r]i  <  x}  >  0  for  all  x.  (By  arguing  more  carefully,  one  can  easily  drop  this  last 
hypothesis.) 

It  turns  out  that  the  fifth  moment  hypothesis  tat  we  have  imposed  is  close  to  the 
right  condition  for  guaranteeing  that  Sn  satisfy  a  FCLT.  DALEY  (1968)  shows  that  for 
the  GI/G/1  queue,  it  is  necessary  and  sufficient  that  Emax(0,  774)  <  oo  in  order  that  the 
series 

OO 

Y.  covn(X0,Xn) 

n=0 

be  absolutely  summable.  This  absolute  summability  condition  is  implicit  in  many  FCLT’s 
for  stationary  processes  (see  ETHIER  and  KURTZ  (1986),  p.  351).  This  suggests  that 
the  “correct”  condition  to  require  for  validity  of  the  FCLT  in  this  setting  is  Er)\  <  oo.  It 
is  reasonable  to  question  why  our  proof  requires  an  additional  moment  on  77! . 

The  basic  reason  is  that  the  martipgale  CLT  basically  applies  to  the  additive  functional 
(Sn  :  n  >  0)  whenever  EnD\  <  00,  where  Dk  =  g(Xt )  —  (Pg)(Xk-i)-  Suppose  that 
g  e  L2(n).  Then,  g(Xk)  -  (Pg)(Xk-i)  is  orthogonal  to  (Pg)(Xk-i),  so  that 

E,Dl  =  E,g2( A'0)  -  E„(Pg)(X0)2. 
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The  approach  that  we  have  followed  in  this  paper  to  show  that  EnD2k  <  oo  is  to  establish 
sufficient  conditions,  using  Lyapunov  functions,  for  the  finiteness  of  Eng2(X o).  This  is  the 
standard  technique  used  in  the  literature  to  verify  square  integrability  of  D*.  However,  in 
this  example,  we  believe  that  if  Eg\  <  oo  with  E\r]i\5  =  oo,  then  geL2(ir)  but  EnDl  < 
oo.  Thus,  our  analysis  does  not  obtain  the  appropriate  moment  condition  because  it  is 
not  a  fine  enough  tool  to  be  able  to  pick  up  “cancellation”  that  occurs  between  g(Xn) 
and  (Pg)(Xn_i).  However,  it  seems  likely  that  in  most  examples,  the  cancellation  effect 
is  probably  insignificant.  Thus,  one  can  expect  that  in  general,  the  Lyapunov  function 
method  described  in  this  paper  should  be  capable  of  obtaining  moment  conditions  that 
are  close  to  optimal.  This  is  illustrated  in  our  next  example. 

EXAMPLE  3.  Let  A'n+i  =  pXn  -f  r?n+i,  where  ( r)n  :  n  >  1)  is  i.i.d.  To  simplify  our 
discussion,  we  shall  require  that  T]n  has  a  continuous  Lebesque  density  that  is  strictly 
positive  everywhere.  The  chain  X  =  ( Xn  :  n  >  0)  given  in  this  example  is,  of  course,  just 
a  first-order  autoregressive  sequence.  For  stability  of  X,  we  shall  demand  that  |/>|  <  1  and 
£|77i|  <  oo.  As  in  Example  2,  it  is  easily  checked  that  condition  (2.6)  holds  whenever  A  is 
a  compact  subset  of  (— oo,  oo)  (we  can  take  v  equal  to  Lebesque  measure  on  [0, 1]). 

Suppose  that  /(x )  =  x.  We  claim  that  if  Erj\  <  oo,  then  Sn  =  Xi  +  . . .  +  Xn  satisfies 
a  FCLT.  To  see  this,  we  put  /i(x)  =  |x|  and  k(x )  =  x2.  Then, 

(Ph((x)  <  | p-  |x|  +  E\rji\ 

=  Mx)  -  |/(x)|(l  -  \p\)  +  0(1) 

and 

( Pk)(x )  =  p2x2  +  2pxEr)\  +  Eg \ 

=  k(x)  +  (p2  -l)h2(x)  +  0(x) 

as  x  — *  oo.  Again,  an  appropriate  choice  of  e,  77,  and  K  prove  that  conditions  (2.6)- 
(2.S)  hold  for  A  =  [— K,  K\.  Thus,  the  condition  Eg2  <  00  suffices  to  guarantee  that 
(Sn  :  n  >  0)  satisfies  a  FCLT.  We  note  that  the  Lyapunov  function  method  that  we  have 
applied  produces  the  minimal  moment  condition  required  for  this  FCLT. 
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